BDA-SketRet: Bi-level domain adaptation for zero-shot SBIR

نویسندگان

چکیده

The efficacy of zero-shot sketch-based image retrieval (ZS-SBIR) models is governed by two challenges. immense distributions-gap between the sketches and images requires a proper domain alignment. Moreover, fine-grained nature task high intra-class variance many categories necessitates class-wise discriminative mapping among sketch, image, semantic spaces. Under this premise, we propose BDA-SketRet, novel ZS-SBIR framework performing bi-level adaptation for aligning spatial features visual data pairs progressively. In order to highlight shared reduce effects any sketch or image-specific artifacts, symmetric loss function based on notion information bottleneck while cross-entropy-based adversarial introduced align feature maps. Finally, our CNN-based model confirms discriminativeness latent space through topology-preserving projection network. Experimental results extended Sketchy, TU-Berlin, QuickDraw datasets exhibit sharp improvements over literature.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Zero-Shot Deep Domain Adaptation

Current state-of-the-art approaches in domain adaptation and fusion show promising results with either labeled or unlabeled task-relevant target-domain training data. However, the fact that the task-relevant target-domain training data can be unavailable is often ignored by the prior works. To tackle this issue, instead of using the task-relevant target-domain training data, we propose zeroshot...

متن کامل

Zero-Shot Domain Adaptation via Kernel Regression on the Grassmannian

Most visual recognition methods implicitly assume the data distribution remains unchanged from training to testing. However, in practice domain shift often exists, where real-world factors such as lighting and sensor type change between train and test, and classifiers do not generalise from source to target domains. It is impractical to train separate models for all possible situations because ...

متن کامل

Hashing in the zero shot framework with domain adaptation

Techniques to learn hash codes which can store and retrieve large dimensional multimedia data efficiently, have attracted broad research interests in the recent years. With rapid explosion of newly emerged concepts and online data, existing supervised hashing algorithms suffer from the problem of scarcity of ground truth annotations due to high cost of obtaining manual annotations. Therefore, w...

متن کامل

Zero-Shot Domain Adaptation: A Multi-View Approach

Domain adaptation algorithms attempt to address situations where our training (source) data distribution and test (target) data distribution differ, potentially by a substantial amount. For example, in a natural language processing task there may be many important phrases in our target genre which are required for low target error but do not occur in our source training set or even have support...

متن کامل

Few-Shot Adversarial Domain Adaptation

This work provides a framework for addressing the problem of supervised domain adaptation with deep models. The main idea is to exploit adversarial learning to learn an embedded subspace that simultaneously maximizes the confusion between two domains while semantically aligning their embedding. The supervised setting becomes attractive especially when there are only a few target data samples th...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Neurocomputing

سال: 2022

ISSN: ['0925-2312', '1872-8286']

DOI: https://doi.org/10.1016/j.neucom.2022.09.104